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Abstract 

In this paper new results on personalized PageRank are shown. 
We consider directed graphs that may contain dangling nodes. The 
main result presented gives an analytical characterization of all the 
possible values of the personalized PageRank for any node. We use this 
result to give a theoretical justification of a recent model that uses 
the personalized PageRank to classify users of Social Networks Sites. 
We introduce new concepts concerning competitivity and leadership 
in complex networks. We also present some theoretical techniques to 
locate leaders and competitors which are valid for any personalization 
vector and by using only information related to the adjacency matrix 
of the graph and the distribution of its dangling nodes. 



1 Introduction 



Much effort has been done in some aspects related to PageRank and its 
applications since the introduction of the PageRank algorithm to rank pages 
on the web We are interested in the use of the so-called personalization 
vector to bias the PageRank to some nodes. We refer the reader to |10] and 
[3] for the theoretical basis of the PageRank algorithm. 

The idea of biasing the PageRank vector using a personalization vector 
was, in fact, suggested originally in The first time that someone uses 
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the personalization vector to bias to some topics appears in [6]. In [7] some 
different ways of biassing the PageRank with personalization vectors are 
summarized. In [5] the authors propose to use the personalization vector to 
bias the PageRank to pages that were visited more frequently by previous 
users. To reduce computational complexity the usual strategies consist in 
taking low rank approximations |15] or to decompose into subgraphs [9], |16| . 
Another approach consists in using Monte Carlo methods to compute only 
the top-k Personalized PageRank pQ. 

As a centrality measure, Personalized PageRank can also be used to 
classify users in Social Network Sites |12] , [13] , [2] . A way of using the Per- 
sonalized PageRank to rank nodes in an SNS is by using the personalization 
vector to incorporate features of the users. These features can be popular- 
ity (e.g., the number of friends or followers of the user), activity (e.g., the 
number of actions made by the user) and recentness (e.g., the up-to-date of 
the actions of the user in the SNS). In |12j . the fundamentals of a model 
that uses the Personalized PageRank to rank users is SNS were presented. 
This model left open some theoretical questions. One of these questions is to 
what extend one can use the personalization vector to modify the PageRank 
vector. In this paper we address this question and we show, in particular, 
that the component i of the PageRank vector is bounded, being this bound 
a sharp one, and valid for any personalization vector. We also derive some 
theoretical properties that let us detect nodes that compete with each other 
to gain PageRank. We also give some generalizations to some definitions 
introduced in |12] , 

The structure of the paper is as follows. In section [2] the basic definitions 
and results used in the rest of the paper are presented. In addition to this, a 
technical general lemma about row stochastic matrices is proved in order to 
provide the tools of the results of the following sections. Section [3] is devoted 
to prove the main result of the paper that locates all the possible values of 
the personalized PageRank for each node of a network. Finally, section [5] 
presents several applications of the localization theorem proved before. The 
applications include an analytical result that gives necessary and sufficient 
conditions for the competitivity between nodes and a characterization of the 
leadership of nodes in a complex network. These analytical results give some 
easy algorithms to locate leaders and competitors which are valid for any per- 
sonalization vector and only use information related to the adjacency matrix 
of the graph and the distribution of its dangling nodes. In this final section 
several examples are presented in order to illustrate the results proved. 

2 Some definitions and a technical lemma 

Let Q = (J\f,£) be a directed graph where M = {1,2,... , n} and n € N. 
Note that all the results presented in this paper deal with directed networks, 
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but they can be straightforwardly stated for un-directed networks. The link 
belongs to the set £ if and only if there exists a link connecting node i 
to node j. The adjacency matrix of Q is an n x n- matrix 



A = (dij) where aj 



1, if is a link of Q 
0, otherwise. 



A link is said to be an outlink for node i and an inlink for node j. We 
denote k ou t{i) the outdegree of node i, i.e., the number of outlinks of a node 
i. Notice that k ou t{i) = ^2k a ik- The graph Q = {M,£) may have dangling 
nodes, which are nodes i £ Af with zero outdegree. 

Let P = (pij) € M nxn be the row stochastic matrix associated to Q 
defined in the following way: 

• if i is a dangling node, pij = for all j = 1, . . . , n, 

* otl ™ise, Pij = £^iy = j^- 

Vectors of M n will be denoted by column matrices. In particular, 
ei =(1,0,- •• ,0) T £K n , 

e n =(0,--- ,0,lfel", 
e =ei H he n = (1, • • • , 1) T . 

The i th -component of a vector v = - ,v n ) T € ffi n is given by the 

product v T ej = Uj, and the sum of the components of the vector v € M n is 
1 if v r e = 1. Moreover, we will say that v > if all the components Vi of v 
are greater than zero, i.e., v T e^ > 0, i = 1, . . . , n. 

We will use the personalized PageRank vector. The ingredients to build 
such PageRank vector are: 



A damping factor a S (0, 1). 

A distribution of dangling nodes u € W 1 such that u > and u T e = 1 . 
The dangling nodes will be characterized by a vector d £ M n defined 
as d = (d\, . . . ,d n ) T , where 



di 



1, if i is a dangling node of Q 
0, otherwise. 



• A personalization vector v G W 1 such that v > and v r e = 1. 

The Google matrix G = G(a, u, v) with dangling nodes and personalized 
vector v is defined as 

G = a(P + du T ) + (1 - a)ev T G R nxn (2.1) 
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(this matrix G is row-stochastic, i.e., Ge = e). The PageRank vector tt = 
7r(a, u, v) is the unique eigenvector of G T associated to eigenvalue 1 such 
that ir T e = 1, i.e., tt > 0, ir T e = 1 and ir T G = tt t (see [TT]). 

From now on we will consider a fixed damping factor a (usually a = 0.85) 
and a fixed distribution of dangling nodes u, so the PageRank matrix G and 
the PageRank vector will only depend on the personalization vector v we 
are considering. 

Since ir T G = tt t , from the definition of G in (|2.ip and the fact that 
ir T e = 1 we get that 

tt t = tt t G = ir T (a(P + du T ) + (1 - a)ev T ) 
= an T {P + du T ) + (1 - a)vr T ev T 
= air T (P + du T ) + (1 - a)v T 

so ir T (I n — aP — adu T ) = (1 — a)v T , where /„, £ JR nx?1 is the identity matrix. 
Therefore it was shown in [3] that 

vr T = (l-a)v T (/ n -a(P + du T ))- 1 . (2.2) 

We will denote by X the n x n-matrix appearing in formula (|2.2p above 

X = (1 - a)(I n - a(P + du 7 ))" 1 , so vr T = v T X. 

Notice that formula (|2.2[) indicates that the PageRank of each node can be 
expressed as a function of the personalization vector v since it = vr(v) = X T \r 
(see [3])- Notice that this equality makes sense for all v € M n and gives the 
PageRank when v > and v T e = 1. 

It is easy to check that the matrix P u = P + du T appearing in (|2.2p is a 
row-stochastic matrix since 

P u e = (P + du T ) e = Pe + du T e = Pe + d = e. 

In the next section we will use the following lemma dealing with row-stochastic 
matrices as P u : 

Lemma 2.3. Let Q be a row- stochastic matrix and a € (0,1)- Then the 
matrix Y = I n — aQ is strictly row-diagonally-dominant, X = (1 — a)Y~ l is 
strictly diagonally- dominant of its column entries and the maximum of each 
column i of X is achieved 

Proof. Clearly Qe = I n e — aQe = (1 — a)e, i.e., the sum of the entries of 
each row of Q is 1 — a. Therefore, since a € (0, 1) and < q,^ < 1 for all 
i, k = 1, . . . , n, we get that 

\ya\ = |1 - aqa\ = 1 - aqu = 1 - a + a ^ q ik > a ^ q ik = ^ \y ik \, 



4 



i.e., Y is strictly row-diagonally-dominant. Now, by Theorem 2.5.12 in [8], 
Y^ 1 and X = (1 — a)Y~ l are strictly diagonally-dominant of their column 
entries and therefore for every k ^ i 

Moreover, since Y is a (nonsingular) M-matrix (see, for example, [2]) we 
have that Y~ l > 0. Hence the absolute values in the formula above can be 
deleted and we get 

max — X{{ . 
k 

□ 

3 Main result: Location of Personalized PageRank 

The main contribution of this paper is the solution to the following problem: 

Problem. Given a graph Q with dangling nodes indicated by some vector 
d, a fixed damping factor a G (0, 1) and fixed dangling nodes distribution 
u, is there an easy way to locate all the possible values of the PageRank for 
each node i? 

Definition 3.1. Given a graph Q with dangling nodes indicated by some 
vector d, a fixed damping factor a G (0, 1) and fixed dangling nodes distri- 
bution u, for each node % G M we define VlZ{i) as the set of all possible 
values of Personalized PageRank of node i, i.e., 

VK(i) = {ir T (v)ei for all v G W 1 , v > 0, v T e = 1} C (0, 1). 

The following theorem shows that V1Z(i) coincides with an open interval 
whose extreme values are given by the the maximum and minimum entries 
of the i th -column of X. 

Theorem 3.2. Given a graph Q with dangling nodes indicated by some vector 
d, a fixed damping factor a G (0, 1) and fixed dangling nodes distribution u, 
for each node i G N 

VTZ(i) = (min^j, xu), 
j 

where X = (x-ij) = (1 — a)(I n — a(P — du T )) _1 is the matrix appearing in 
formula H2. ty) . 

Proof. We will separate the proof of the theorem in two steps: 

Step 1. minjXji < VTZ(i) < xa for every personalization vector v; 

Step 2. every x with min^ Xji < x < xu can be achieved as the PageRank of 
node i for a certain personalization vector v. 
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Proof of Step 1. Without loss of generality we can suppose that i = 1. Let 
v G lR n such that v T e = 1. Then the first component of vr(v) is 



7r T (v)ei = v T Xe\ = v 5 



In particular, if v is a personalization vector (v > and v T e = 1), vr(v) is 
the PageRank corresponding to this personalization vector and the formula 
above gives the first component of the PageRank. Since in this case all the 
components of v are positive and ^ • Vj = 1, ^ • VjXji is a strict convex com- 
bination of the entries of the first column of X and mim,- Xji < Y2j v j x ji < 
maXjXji. Moreover, by Lemma |2.3| maxjXji = xu and Step 1 is shown. 

Proof of Step 2. Without loss of generality suppose again that i = 1. By the 
calculations done in Step 1, the first component of 7r(v) of every v 6 M n , 
v T e = 1, equals £^ v j x ji- I n particular, the first component of 7r(ei) is x\\, 
the first component of 7r(e2) is x%i, etc., and the extreme values of the open 
interval 

VTZ(1) = (minsGji, in) 

3 

would be achieved if we admitted ei and , where we denote by j\ an index 
where the minimum of the first column of X is reached. 
Now we define 



/ 1-e \ 



e 

n-1 

£ 

n-1 



1-e 



ji coordinate 



for every e € (0, 1). Then it is easy to check that both vi £ > and Vj l£ > 0, 



vf £ e = 1 = vj i£ e, and 



lim 7r (vi e )ei = xu, 

£->0+ 



lim 7r (vj ie )ei = 

£->0 + 



Finally, for every A € (0, 1) we define 

v A £ = Av ie + (1 - A)v ilE > 

which satisfies that 



lim 7r (v Ae )ei = Xxn + (1 — X)xj 1 i, so 

£->-0+ 



lim lim ir (v\ e )ei = x\\ 
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lim lim 7r T (v A£ )ei = x h i 

and hence for every x with Xj x \ < x < x\\ there exists some £q, Xq G (0, 1) 
such that 

7r T (vA 0£0 ) e l = x - 

□ 

Remark 3.3. Note that if v > such that v T e = 1, then for every i G M 
7r T (v)ej, is the PageRank of node i when using the personalization vector v. 
A convenient notation for this value is PR(i,v) = 7r T (v)ej. We note here 
that the personalization vectors considered in |12| were of the form Vj e and 
there the definitions only deal with PR(i,Vj e ). The competitivity interval 
in the sense of |12| is defined as 

Sc(i,e) = [mmPR(i,v je ),maxPR(i,v je )], 

for every e G (0, 1) and each i G N . Then from Theorem 13.21 it is clear that 
for a given e G (0, 1) and each i G M we have 

S c (i,e) cVK(i) = \JSc(i,e). 
4 Some applications 

In addition to the intrinsic interest of the previous results, the techniques 
developed in the last section can be useful in order to analyze the competi- 
tivity of nodes in a network according to their Personalized PageRank and 
other problems such as the localization of leaders in a complex network. It 
is well known that Personalized PageRank is a very remarkable tool that 
helps ranking the nodes of a network according to their centrality (see, for 
example, [3"1 [12]). This main fact makes that in many real- life networks 
(such as WWW networks or social networks) it is crucial for a node i to 
spot other nodes that can be overcome by i in a ranking based on Personal- 
ized PageRank, since these nodes are the nodes that actually compete with i 
in the ranking based on Personalized PageRank. This problem has already 
been considered in the literature (see, for example, |12]). The techniques 
developed in the previous section can give a computationally efficient solu- 
tion to the characterization of the competing nodes of a fixed vertex i. Let 
us start stating the basic definition of competitivity between two nodes in a 
complex network. 

Definition 4.1. Given two nodes i,j (i ^ j) of a graph Q = (J\f,£), we say 
that i and j are effective competitors if there exist two personalization vectors 
v, w (v, w > and v r e = 1 = w^e) such that the i th -component of the 
personalized PageRank with respect to v is greater than the j th -component 
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of the personalized PageRank with respect to v, but the i -component of the 
personalized PageRank with respect to w is smaller than the j th -component 
of the personalized PageRank with respect to w, i.e., 

7r T (v)ej > 7r T (v)ej 
7r r (w)ej < ir T (-w)ej. 

This definition means that nodes i and j appear with different rank in the 
personalized PageRank vector if we consider some different personalization 
vectors v and w. 

Remark 4.2. Note that this definition is more restrictive than the definition 
of competitivity group given in |12| . Furthermore note that the fact of being 
in the same competitivity group is a necessary but not a sufficient condition 
to be effective competitors. Later we show some examples of this fact. 

We will see in this section that the results and techniques coming from 
the last section give a positive answer to the following question: 
Question. Is there an easy method of knowing whether two given nodes are 
effective competitors or not? 

This question and this kind of problems have been posed in the literature 
in social networks, and actually in |12] a necessary condition for a couple of 
nodes i, j 6 M to compete is given in terms of the so-called competitivity 
intervals. We will see in example 14.51 that the result used in |12] only gives 
necessary conditions for competitivity between nodes, while the following 
result gives a complete characterization of the competitors of a given node. 

Theorem 4.3. Given a graph Q = (TV, £) with dangling nodes indicated by 
some vector d, a fixed damping factor a € (0, 1) and fixed dangling nodes 
distribution u, two nodes i,j £ Af are effective competitors if and only if 
there exist k,£ £ {1, . . . ,n} such that 

x ki > x kj and x ei < x ej , 

where X = {x pq ) = (1 — a)(I n — a(P + du- 2 "))^ 1 is the n x n-matrix given in 
formula \2. fy) . 

Proof. If we consider v ke and v^ e as defined in the proof of theorem I3.2| 



lim 7r T (v fc£ )ei 


— ^kii 


lirn7r T (v te )e j 




lim 7r T (v£ £ )ei 


= xu, 


lim 7T 7 Yv/ F )e, 


= X£j, 
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so from Xki > xtj and xu < xij there exists e > such that the choice of 
Vfc £ or V£ £ as personalization vectors exchanges the order of nodes i and j in 
the PageRank vector with respect to such personalization vectors. 

Conversely, suppose that i and j are effective competitors but for all k G 
{1, . . . ,n} x^ > x kj (similarly, x^i < Xkj)- By hypothesis, there exist some 
personalization vectors v, w such that 7r T (v)ej > -K T {v)ej and 7r r (w)ej < 
ir T (w)ej. In particular, if w T = (wi, . . . , w n ), 



Remark 4.4. This theorem gives an easy way to search for effective competi- 
tors: it is enough to compare the i th -column and the j th -column of matrix 
X; if each entry of the i th -column is always greater or equal than the corre- 
sponding entry of the j th -column (or if it is always smaller or equal), then 
nodes i and j are not effective competitors. Otherwise, some change in the 
sign of the difference between columns i and j provide the existence of effec- 
tive competitors. Moreover, if the changes of sign occur in rows k and £, we 
can assure that there exists e > such that v^ e and v&, are personalization 
vectors that make nodes i and j compete. 

Let us present an example of the use of the previous result and how 
the intersection condition presented in |12] gives less information than the 
corresponding one obtained from theorem 14.31 

Example 4.5. Let us consider the network Q\ = (Vi,Ei) given in figure{J\ 



7T (w)e, < 7T (w)ej 




leading to a contradiction. 



□ 




Figure 1: A directed network Q\ = (V\,Ei) with 3 nodes 



The adjacency matrix of Q\ is 
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Then, since Q\ has no dangling nodes, if we fix a = 0.85, then we can 
compute the matrix (xij) = X\ = (1 — a) (I3 — aP)" 1 obtaining 

( 0.4035 0.4186 0.1779 \ 
Xi = 0.2982 0.4925 0.2093 . 
\ 0.2982 0.3872 0.3146 / 

Hence, by using theorem 13.^1 we get that 

VTZ(l) = (0.2982,0.4035), 
VK{2) = (0.3872,0.4925), 
VTZ(3) = (0.1779,0.3146). 

If we use the necessary conditions obtained in we get that node 1 could 
compete with nodes 2 and 3, but nodes 2 and 3 cannot compete between them 
since VK(1) n VK(2) ^ ^ VK(l) n VK{3) and VK{2) n VK(3) = 0. 

In addition to this, if we use the criterion given in theorem \4-3\ we note 
that while 1 and 3 are actually effective competitors, nodes 1 and 2 do not 
compete. Indeed, by comparing on the one hand the first with the third column 
of X\ we get that x±\ > X\s and X21 < X33 while, on the other hand, by 
comparing the first and the second columns of X\ we get that xn < x^ for 
all i = 1,2, 3. 

Another type of problems that can be solved by using the techniques 
introduced in the previous section deal with leadership of nodes. The lead- 
ership in complex networks has been studied in the Complex Networks Anal- 
ysis from very different points of view, including (among others) the use of 
efficiency and robustness perspective in networks related with cryptography 
(see [3]) and Personalized PageRank in social networks (see |12]). Roughly 
speaking a node i is a leader (for the personalized PageRank-based ranking) 
if its personalized PageRank is maximal among all the nodes of the network 
for some personalization vector. This concept was studied in |12j but only 
considering personalization vectors of the form v J£ . As an extension of this 
concept we introduce the following definition. 

Definition 4.6. Given a node i of a graph Q = (N,£), we say that i is 
a leader of Q if there exists a personalization vector v € W 1 (v > and 
v T e = 1) such that for every node j £ N (j ^ i) 

7r T (v)ei > 7r T (v)ej. 

The set of all leader nodes of a graph Q is called the leadership group of the 
network. 

Once we have considered the definition of the leadership group of a graph 
Q it is natural to ask the following question: 



10 



Question. Is there an easily-computable way to determine the leadership 
group of a graph Ql 

Once more this question was considered in |12| and some results in terms 
of competitivity intervals were presented, but they only gave sufficient con- 
ditions for a node i to be a leader of the network. By using our methods we 
can go further and prove the following result: 

Theorem 4.7. Given a graph Q = (Af,£) with dangling nodes indicated by 
some vector d, a fixed damping factor a € (0, 1) and fixed dangling nodes 
distribution u, the leadership group of Q is the set of nodes i € M verifying 
that there is a value j € TV such that for every k € M (k ^ i) 

Xji 7> Xjki 

where X = (x pq ) = (1 — a)(I n — a(P + du^))" 1 is the n x n-matrix given in 
formula \2. #)) . 

Proof. Let us denote 

A = {i 6 AT; i is a leader of Q} , 

B = {i € AT; 3j € M : Xji > xjk for all k ^ i} . 

On the one hand, if we take i £ B, since there is a value j G M such that 
for every k ^ i we get that Xji > Xjk, by using the same techniques (and 
notation) as in the proof of theorem [221 a simple continuity argument makes 
that there is an e 6 (0, 1) such that for every k ^ i 

7r T (v j£ )ei > ir T (v jE )e k , 

which makes that i € A and therefore A C B. 

On the other hand, if i 6 A, there is a personalization vector v € ffi such 
that for every k ^ i we know that 7r T (v)ej > 7r T (v)efc. As it was proved in 
step 1 of the proof of theorem 13.21 if we denote v = (v\, ■ ■ ■ , v n ) we get that 
for every k ^ i 

^ VjXji = 7r T (v)ei > 7r r (v)e fc = ^2 V 3 X jk- (4.8) 

3 3 

We are going to show that if the last expression holds, then there is a value 
j £ jV such that Xji > Xjk for all k ^ i, otherwise for every j G M it should 
be that Xji < Xjk and hence for every k ^ i 

7r T (v)ei = ^VjXji < ^VjXjk = ir T (v)e k , 
j j 

which contradicts equation (|4.8p . Therefore there is a value 1 < j < |W| 
such that Xji > Xjk for all k 7^ i, which makes that i 6 B and hence B C A 
and we conclude the proof. □ 
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Remark 4.9. Note that the last result gives an effective algorithm to locate 
the leadership group of a network Q = (Af,£). It is enough to spot the 
maximum of each row of the n x n-matrix X given in formula (|2.2p and if 
it takes place at the element Xij, then the node j is a leader of the network. 
Actually, the last result ensures that the only possible leader nodes of the 
networks are those who fulfil this property. 

Therefore the matrix X = (x pq ) = (1 — a)(I n — a(P + du T )) _1 encap- 
sulates a lot of useful information about the personalized PageRank of the 
network: The extremal values on each column i correspond to the extremal 
values of the set V1Z(i), the comparison between two columns j ^ k gives the 
information about the effective competitivity between j and k and finally, 
the maximum on each row gives a leader node of the graph. 



Let us finish this section with a couple of examples that illustrate the use 
of the last result. 

Example 4.10. Let us take the network Q2 = (V^E^) given in figure^ 




Figure 2: A directed network Q2 = (V^-E^) with 5 nodes 



The adjacency matrix of Q2 is 



An 



( 1 1 1 \ 

10 10 

1 

1 

V 1 / 



Then, since Q2 has no dangling nodes, if we fix a = 0.85, then we can 
compute the matrix X2 = (1 — a) (I§ — aP)~ l obtaining 



Xo 



( 0.3514 0.0995 0.1419 0.2201 0.1871 \ 

0.2410 0.2183 0.1611 0.2052 0.1744 

0.2158 0.0611 0.2371 0.2627 0.2233 

0.2539 0.0719 0.1025 0.3090 0.2627 

\ 0.2986 0.0846 0.1206 0.1871 0.3090 / 
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Now, theorem \3.2\ determines the set of all possible personalized PageRank 
values of all the nodes and we get that 

VTZ(l) = (0.2158,0.3514), 
VK{2) = (0.0611,0.2183), 
VTZ(3) = (0.1025,0.2371), 
VTZ(4) = (0.1871,0.3090), 
VTZ(5) = (0.1744,0.3090). 

Note that the maximum of the first and second column is reached at x\\ 
and X21 respectively. The maximum of the third and forth column is reached 
at X34 and X44 respectively, and the maximum of the last row is reached at 
X55 . Therefore, by using the method given by theorem \4- 7| we get that the 
leadership group is {1,4,5}. 

Example 4.11. Finally, let us now take the network Q% = (^,£3) that was 
introduced in }17\j (see figure^). 




Figure 3: A directed network Q3 = (^,£3) with 6 nodes introduced in |17] 
The adjacency matrix of is 





1 


1 








\ 


1 








1 








1 








1 




















1 


1 











1 








I 








1 





) 



Then, since Q3 has no dangling nodes, if we fix a = 0.85, then we can 
compute the matrix X3 = (1 — a) (Iq — aP) 1 obtaining 

I 0.2348 0.0998 0.0998 0.3057 0.1299 0.1299 \ 

0.0998 0.1924 0.0424 0.3597 0.1529 0.1529 

0.0998 0.0424 0.1924 0.3597 0.1529 0.1529 

3 " 0.5405 0.2297 0.2297 ' 

0.4595 0.3453 0.1953 

V 0.4595 0.1953 0.3453 / 
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In order to determine the set of all possible personalized PageRank values for 
all nodes, we use once more theorem VS. "A and we obtain that 

VK{1) = (0, 0.2348), Vn(4) = (0.3057, 0.5405), 
VTZ(2) = (0, 0.1924), VTZ(5) = (0.1299, 0.3453), 
VK(S) = (0,0.1924), VTZ(6) = (0.1299,0.3453). 

From theorem \4- 7| we have that the the leadership group is {4}. We recall 
here that matrix G given by \2. 1\) is always an irreducible matrix since v > 0. 
Nevertheless, X% may be a reducible matrix as it happens in this example. 
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